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The (111) surface of SnTe hosts one isotropic f-centered and three degenerate anisotropic M- 
centered Dirac surface states. We predict that a nematic phase with spontaneously broken C 3 
symmetry will occur in the presence of an external magnetic field when the N = 0 M Landau levels 
are 1/3 or 2/3 filled. The nematic state phase boundary is controlled by a competition between 
intravalley Coulomb interactions that favor a valley-polarized state, and weaker intervalley scattering 
processes that increase in relative strength with magnetic field. An in-plane Zeeman field alters the 
phase diagram by lifting the three-fold M Landau level degeneracy, yielding a ground state energy 
with 27 t/ 3 periodicity as a function of Zeeman-field orientation angle. 


— Tin telluride (SnTe) is now attract¬ 
ing great attention as the first topological insulator (TI) 
protected purely by crystalline symmetry. Although its 
electronic band structure has been understood [ 1 ] for 
decades, the physical consequences of its band inversion 
have only recently been fully appreciated [ ]. SnTe has a 
rocksalt crystal structure with two inter-penetrating face- 
centered cubic lattices, and its bulk bands are inverted 
due to spin-orbit coupling at four L points. The mir¬ 
ror Chern number becomes nontrivial in mirror-invariant 
planes that each contains a pair of L points. Based on 
this property, Dirac surface states on selected surfaces 
respecting mirror symmetries were first predicted [ 2 ] and 
later observed [3-5]. The (111) surface of SnTe [6-13] 
respects three mirror symmetries, and each protects an 
anisotropic gapless Dirac surface state at M and a part¬ 
ner isotropic state at F, as sketched in Fig. 1(a). 

In crystalline topological insulators the top and bot¬ 
tom surfaces of thin films can be electrically isolated [ 8 ] 
by breaking mirror symmetries on the side surfaces while 
leaving them time-reversal-invariant. This behavior con¬ 
trasts with the case of strong TI thin films for which 
it is impossible to study single surface electrical prop¬ 
erties because sidewalls can be gapped only by break¬ 
ing time-reversal symmetry that generates Hall currents. 
The (111) surface of SnTe therefore hosts a unique and 
relatively unexplored isolated two-dimensional electron 
gas (2DEG) system in which the interplay between topo¬ 
logical surface properties, valleytronics, and many-body 
interactions is likely to yield unexpected phenomena. 

The integer quantum Hall (QH) effect is a hallmark 
of any 2DEG system. When a 2DEG has Landau- 
level degeneracies due to spin, valley, and/or layer de¬ 
grees of freedom [14-16], the interplay between Lan¬ 
dau quantization and electron-electron interactions often 
leads to ground states in which symmetries associated 
with the aforementioned degrees of freedom are sponta¬ 
neously broken. Examples of broken symmetry states of 
this type, often referred to as QH ferromagnets, arise in 
GaAs and AlAs quantum wells [17, 18], single and mul¬ 
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FIG. 1. (a) Typical equal-energy contours for gapless Dirac 
states on the (111) surface of SnTe. The three mirror invari¬ 
ance lines are indicated by dotted lines, (b) and (c) Single¬ 
particle LL structures of (a). The energy difference between 
f and M Dirac points is 30 meV in (b) and —20 meV in (c). 
Brown and blue lines represent the non-degenerate F LLs and 
the three-fold degenerate M LLs, respectively. The integer la¬ 
bels in (b) and (c) give LL filling factors in spectral gaps. 


tilayer graphene sheets [19-21], and on the surfaces of 
silicon [22, 23] and bismuth [24, 25]. In all instances of 
QH ferromagnetism studied to date, however, the nonin¬ 
teracting LL degeneracy N has always been even. Thus 
one may wonder whether QH ferromagnetism with odd N 
exists in some material, and how in this case the ground 
state breaks Hamiltonian symmetries. 

In this Letter, we show that the (111) surface of 
SnTe provides a platform to explore SU( 3) QH ferromag¬ 
netism. As illustrated in Fig. 1, the four Dirac cones on 
the (111) surface give rise to four LL sequences. The 
three M LL sequences are degenerate and related by 
a C 3 rotational symmetry. The T-M LL energy differ¬ 
ence is not restricted by any symmetry, and can [ 11 ] 
be tuned experimentally. Under a uniform perpendic¬ 
ular magnetic field, these LL sequences are interwoven 
in a non-universal fashion. We focus here on the case in 
which the N = 0 C 3 triplet is at the Fermi level, well 
separated from all f LLs, and 1/3 or 2/3 filled to yield 
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an integer total filling factor. We find that when only the 
stronger intravalley Coulomb interactions are retained in 
the theory, valley symmetry is spontaneously broken to 
create a nematic state in which only one valley is occu¬ 
pied. When the weaker intervalley scattering processes 
are retained, a broken translational symmetry state with 
coherence among three valleys appears beyond a criti¬ 
cal magnetic field value. An in-plane Zeeman field cou¬ 
ples to the nematic order parameter and influences the 
competition between broken rotational and translational 
symmetry states. 

— The SnTe (111) Dirac surface 
states are described by the k ■ p Hamiltonians [8] : 

Hp ?lV(k X Sy kySx)-, - kiV X ky. ^Sy vfcy ^ : (1) 


where v = 4.40 x 10 5 m/s and v x = 2.55 x 10 5 m/s [11] 
are surface Fermi velocities, A = 1,2,3 labels the three 
inequivalent M valleys, and s is a surface Dirac pseu¬ 
dospin. Microscopically the pseudospins [ 8 , 26] are 
valley-dependent linear combinations of spin and orbital 
operators that transform like spin under time reversal, 
spatial inversion, and mirror reflection, k x ^ and k 
are explicitly defined in Fig. 1(a) for the Mi valley; lo¬ 
cal momentum-space coordinates in other valleys are ob¬ 
tained by appropriate C 3 rotations. 

In the presence of a uniform perpendicular magnetic 
field, the 2D kinetic momenta hk in Eq. (1) are re¬ 
placed by 7 r = hk + eA, where A = (0,—B±x). The 
f LL energies are ±(T)=±\/2hv 2 NeB±, reminiscent 
of the massless Dirac fermion LLs in graphene and on 
cleavage surfaces of Bi 2 Se 3 . Because the M surface 
states have anisotropic dispersions with valley-dependent 
orientations, we define valley-dependent raising oper¬ 
ators a\=((./^/2Ti)(ot\'K x — i/3\TT y ), where l=y/h/eB^ 
is the magnetic length, a\=r]cos6\ + irj~ l sin 0\, 
/3a =?? _1 cos 9\ +irjsmO\, r)=x/v x /v, and 9\ = 2(A - 
1 ) 7 t/ 3 . With these definitions becomes 


Hm x 


V2vv x h ( 0 - ia\\ 

t 0 ) 


( 2 ) 


so that the M LL energies and wavefunctions are 
En,±(M\)=±\/ 2Tiv x vNeB ^, and 


V’oa = 


</>0A 

0 


, VbV>0,A,± = 


1 / 4>n\ 

V2 V+T^^v-i’A, 


<t>NX = A- N \e~ a ^/ 2 H N ^ X ). 


( 3 ) 

( 4 ) 
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Here An\={ 2 N N\^ir\a \\£) 2 is a normalization factor, 
t;\=(x — k y £ 2 )/(\ax\£), and LLv(£) is the Hermite poly¬ 
nomial. Also note that a<pN=—ia*/\a\VN<pN-i and 
a(f> o=0. In Fig. 1 we plot LL spectra as a function of 
B± for cases with the F Dirac point energy above and 
below the M Dirac point energy. All the F LLs are non 


degenerate, whereas all the M LLs are threefold degen¬ 
erate because of the C 3 symmetry. 

QH ferrom,agnetism in the N = 0 triplet. — We focus 
here on the case in which the N = 0 LL triplet is 1 /3 or 
2/3 filled, and ask whether Hamiltonian symmetries are 
spontaneously broken and whether broken symmetries 
give rise to charged excitation gaps which would yield an 
integer QH effect. Because Coulomb interaction matrix 
elements are sensitive to the valley-dependent orienta¬ 
tions of the anisotropic cyclotron orbits, the Hamiltonian 
is not invariant under rotations in the valley-space. How¬ 
ever, the small size of the momentum-space cyclotron or¬ 
bits relative to their separation implies that the number 
of electrons in each pocket is conserved; the only allowed 
large momentum transfer processes simply exchange elec¬ 
trons between valleys. Broken symmetry ground states 
are either Ising-like states in which the three symmetry 
equivalent valleys are occupied by different numbers of 
electrons, or XY-like states in which coherence is sponta¬ 
neously established among three valleys oriented along 
different directions. The Ising-like state is a nematic 
one which lowers rotational symmetry, and the XY-like 
state is a commensurate charge-density-wave state which 
breaks the crystal translational symmetry. Interesting 
new physics is most likely to be experimentally accessi¬ 
ble when the N = 0 triplet is partially filled because of 
the large gap separating N = 0 and N ^ 0 LLs in Dirac 
systems. After projecting to the A^ = 0 triplet, states at 
1/3 and 2/3 fillings are related by particle-hole symmetry 
within the triplet, allowing us to focus on the 1/3 case. 
In addition, we neglect the possibility of an accidental 
degeneracy between the N = 0 M triplet and a F LL. 

We employ the unrestricted Hartree-Fock (HF) ap¬ 
proximation [29] which is accurate [30] at the integer to¬ 
tal filling factors of interest. We therefore minimize the 
energy of Slater determinant trial wavefunctions by solv¬ 
ing self-consistent field equations with 3x3 mean-field 
Hamiltonians of the form: 

nf? = EoSxa + Y 0 X ° A ctA (1 - Sxa) 

-X X °A a x-J2 Z 0 TA rrSxa, ( 5 ) 

r^A 


where Eq is the single-particle LL energy which is an 
irrelevant constant that is subsequently set to 0 , and 
A. a x = (cJ.ca) is the triplet density matrix. In Eq. (5) 
Yq 0 ’, Y 0 Act , and Zq t are respectively intravalley exchange, 
intervalley Hartree, and intervalley exchange integrals. 
We use an envelope function approximation for intraval¬ 
ley processes, which are enhanced by the long-range tail 
of the Coulomb interactions and therefore dominant, and 
approximate intervalley processes using a phenomenolog¬ 
ical interaction constant U ~ 27re 2 /eA' where K is a 
primitive reciprocal lattice vector. It follows that the 
Hartree integral is Y 0 A,T = (27r^ 2 ) _1 L r F]/ 0 ' T (0)F ( 5[ ) A (0), and 
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that the exchange integrals are 
drk 27re 2 


= 


= U 


(27r) 2 ek 
I" d 2 k 
I J2n) 


F^{k)F^{-k)e ik - k y t2w ^, ( 6 ) 

(7) 


where e = (esnTe + l)/2 ~ 20 [28] is the effective dielectric 
constant, and F^f (k) is a form factor that accounts for 
the system’s valley-dependent cyclotron-orbit shape: 


*ocT(*0 


72 

VI^aII^Kia +7?) 


exp 


ikl + 7 a 7 Itf,)? 1 
- 2 ( 7 a + 7 ?) 


( 8 ) 


In the above integrals = 1 — waa — w a<T and 

Wz a = 1 - w \°- - w <y\, with w\fj = 7 */( 7 a + 7 *) and 
7a = P\/ol\. If the surface states were isotropic (i.e., 
v = v x and 7 a = 1 ), Fqq (k) would reduce to the circu¬ 
lar cyclotron orbit form-factor exp(— k 2 l 2 /A) [29] that 
accounts for the quantum-smeared N = 0 orbit size 
and shape. The corrections in Eq. ( 8 ) account for the 
anisotropy of the triplet cyclotron-orbits, and for the 
27t/3 differences in anisotropy orientation illustrated in 
Fig. 1, which play an essential role in the interaction 
physics. Because of the C 3 symmetry, the intravalley ex¬ 
change integral matrix A'g ' 7 only has two inequivalent 
matrix elements, larger exchange integrals for electrons 
in the same valley (Xq) on its diagonal and smaller ex¬ 
change integrals for electrons in different valleys (Xq*) for 
its off-diagonal elements. Because we take the interaction 
responsible for valley-exchange electron-electron scatter¬ 
ing to be short-range, the intervalley integrals have only 
off-diagonal matrix elements all of which have the same 
value (Yq and Zq). 

The broken symmetry ground state minimizes the to¬ 
tal energy with respect to the five parameters that char¬ 
acterize the valley spinor, (rie 1 ^ 1 ,T 2 e lLp2 ,rz) T , shared by 
all LL orbitals. Up to a spinor-independent constant, the 
energy per electron is 

£ = 2[(X^-X^)-(Zq-Yq)) (r 2 r 2 + r 2 2 r 3 2 + r 2 r 2 ). (9) 


The 1/3 filling ground state therefore depends on the 
sign of a linear combination of the interaction parame¬ 
ters calculated above. The energy is independent of <p\ 
and ifi 2 because of separate particle number conservation 
in each valley. The spinor-dependent factor on the right 
hand side of Eq. (9) reaches its minimum value 0 when 
the spinor is a single-valley state (ri,r 2 ,rf) = ( 1 , 0 , 0 ), 
(0,1,0), or (0,0,1) and its maximum value 1/3 when 
the ground state is an equal-weight three-valley state, 
7i,r 2 ,r 3 ) = (1,1, l)/v / 3. 

Exchange energies are always stronger between orbitals 
that are more similar. Accordingly, the exchange inte¬ 
grals between electrons in the same valley are stronger 
than those between electrons in different valleys (Xq > 




FIG. 2. (a) In-plane Zeeman energies m\ in units of 

\f2rf' qplbB^I^ as a function of Bn orientation, (b) Phase 
diagram for the state at 1/3 filling of the N = 0 LL triplet 
for egB\\ = 300 T and U = 0.85eV-nm 2 . The red dot de¬ 
notes the critical held B± at which a first-order transition 
occurs between a valley polarized and a three valley symmet¬ 
ric state occurs at Bn =0. The solid blue lines are first-order 
phase boundaries between complete valley polarized states, 
and the dashed red lines are continuous transition boundaries 
between states with coherence between different numbers of 
valleys. The phases labeled by Mi, Mij, and M 123 have a 
full LL spinor that is a coherent superposition of components 
involving one, two, and three valleys, respectively. 


Xq > 0 ) because of the difference in cyclotron orbit orien¬ 
tations. It follows that the ground state is completely val¬ 
ley polarized unless intervalley scattering plays a role. LL 
interaction physics in SnTe surface 2DEGs therefore con¬ 
trasts strongly with the case of graphene 2DEGs which 
has identical isotropic Dirac cones in two different valleys, 
implying that Xq = Xq . Broken valley symmetry states 
at j/ = ±1 in graphene [31-34] therefore have Heisenberg 
character when valley-exchange processes are neglected. 

For the relatively modest anisotropy parameter r) ~ 
0.75 of SnTe we find that the difference between the 
same-valley and different-valley exchange energies is 
small, Xq—Xq =0.0541 e 2 /(el). The short-range valley- 
exchange scattering processes are approximated by a 
momentum-independent interaction with strength U we 
find that Zq — Yo is positive and scales as JJ/l 2 . This 
allows the weak valley-exchange scattering to play a role 
at stronger fields, favoring a ground state which has 
coherence between all three valleys, and is therefore a 
charge-density-wave state with broken translational sym¬ 
metry. For U = 2-Ke 2 /eK = 0.85 eV-nm 2 , a first- 
order quantum phase transition between nematic valley- 
polarized and valley-coherent charge-density-wave states 
occurs at Bf ~ 11 T. In graphene [31-34] and monolayer 
M 0 S 2 [35], however, there is no competition with valley- 
dependent exchange, and the same mechanism induces a 
charge-density-wave ground state at all field strengths at 
filling factors z/ = ±l. 

Zeeman field effects .— We have so far neglected Zee- 
man coupling, which greatly enriches the interaction in- 
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duced integer QH effect of SnTe. We write the total 
magnetic field as 

B = B\\ (cos <j>x + sin cj>y) + B± z, (10) 

using the coordinate frame defined in Fig. 1(a) for the 
crucial in-plane-field orientation (f>. For general <f> the 
Zeeman field breaks mirror symmetries and couples to the 
order parameter by producing valley-dependent single¬ 
particle energies [ 8 , 27], i.e., E 0 —>• E 0 + m\ in the HF 
Hamiltonian (5) with 

1 

m\ = -agg B 

where g is an electron (/-factor, g B is the Bohr magneton, 
and a = g 2 /3 is the real spin weight of the surface pseu¬ 
dospin [ 8 , 27]. The perpendicular field B± does not break 
the C 3 symmetry and contributes only an irrelevant [36] 
valley-independent energy shift of the N = 0 triplet. In 
contrast, the in-plane field B j| breaks C 3 symmetry and 
lifts the N = 0 triplet degeneracy. It follows that in-plane 
fields can yield an integer QH effect at 1/3 and 2/3 filling 
of the N = 0 triplet even in the absence of interactions, 
as illustrated in Fig. 2(a). When B y is parallel (anti¬ 
parallel) to T-M, the triplet level degeneracy is reduced 
to a two-fold degeneracy at 1/3 (2/3) filling. When B y is 
(anti)parallel to f-A', the single-particle gaps at 1/3 and 
2/3 filling are non-zero and identical. 

Valley dependent Zeeman coupling competes with 
electron-electron interactions, and greatly enriches the 
phase diagram by adding 6£ —> ]T] A rn ^ r '\ 1° Eq. (9), fa¬ 
voring complete valley polarized states. The phase di¬ 
agram at e< 7 .B|| = 300T is illustrated in Fig. 2(b). For 
B± < B c ± = (2.81 eV-nm 2 /H) 2 , interactions prefer a valley 
polarized state and (f> simply selects which valley is occu¬ 
pied. First-order phase transitions occur at (j)=6\. When 
Zeeman coupling to a parallel field is included, the abrupt 
transition from valley-polarized to three-valley coherent 
states is interrupted by a region in which </>-dependent 
two-valley coherent states are stable. The stability range 
of the two-valley coherent state is widest when <f> = 9 
Finally, when B± is further increased, three-valley co¬ 
herent states finally emerge, but with ^-dependent and 
unequal valley populations. Valley coherence can there¬ 
fore be modified and continuously tuned by the in-plane 
Zeeman field. 

The shape of the phase diagram in Fig. 2(b) is only 
weakly dependent on the numerical value of egB ||. The 
three first-order transition lines and Bj_ are independent 
of egB\\ changes. A larger value of egB^ expands the areas 
with two-valley coherent states to larger B±. Stronger 
short range interactions shift Bj_ to smaller values be¬ 
cause intervalley interactions increase in importance. On 
the other hand larger surface state anisotropy would in¬ 
crease the critical perpendicular field B±. 


2^2 , . 1 
-3--By cos(/> - 0 A ) + gBj_ 


( 11 ) 


We have shown that because of 
valley-dependent anisotropic cyclotron orbits, intraval¬ 
ley electron-electron interactions in SnTe can reduce ro¬ 
tational symmetries and lift the three-fold degeneracy of 
the M valley N = 0 LLs. The physics which drives this 
broken symmetry is similar to that [37, 31 ] responsible for 
valley polarized nematic states in parabolic spinful band 
systems with an even number of valleys. The triplet case 
discussed here is distinguished by its SU(3 ) order pa¬ 
rameter space, and by the way Zeeman interactions with 
parallel fields couple to the order parameter. Zeeman in¬ 
teractions play a key role because parallel fields break the 
mirror and C 3 symmetries that protect the three M val¬ 
ley surface Dirac states. Our theory can be extended to 
study QH effects on the surfaces of silicon [22, 23] and bis¬ 
muth [24, 25]. We predict that, intervalley interactions 
will become important at sufficiently strong fields and 
drive a transition from a valley-polarized nematic state 
to a commensurate charge-density-wave state with inter¬ 
valley coherence, and that the phase boundary between 
them is enriched by in-plane field Zeeman coupling. 

In the thin-film case [39], Coulomb interactions be¬ 
tween 2DEGs localized on top and bottom surfaces are 
important. We expect that in this case integer QH effects 
at total filling factor v? = 0 will be spatially indirect ex- 
citon condensates. Our theory can also be extended to 
study SU{3) symmetry breaking in N =^0 LL triplets. In 
this case, we expect similar competing ordered states but 
smaller exchange interactions, and the Zeeman-coupling 
effect is enriched but will still retain the 2 - 7 r /3 periodicity 
in B || orientations. 

The first step experimentally in studying the inter¬ 
action physics we address would be to verify the LL 
structure we predict using field-angle dependent magne¬ 
toresistance or magnetic torque magnetometry [24, 25]. 
The energies of F and M valley LLs are \/Nv 2 B± and 
\/Nvv x B± , respectively. Their crossings, illustrated in 
Fig. 1, should lead to pronounced peaks in longitudi¬ 
nal magnetoresistance. We note the LL crossing fields 
may be controllable by varying the surface potential [ 1 1 ] , 
which tunes the energy difference between the F and M 
Dirac points. An in-plane Zeeman field splits the SU( 3)- 
invariant triplets, with 2n/3 periodicity as a function of 
Zeeman-held orientation. Since Shubnikov-de Haas os¬ 
cillations have recently been observed on the ( 001 ) sur¬ 
face of SnTe [40], we expect future progress to be rapid. 
The phase diagram Fig. 2(b) is expected to be observable 
only in low-disorder samples, since the transport activa¬ 
tion gaps associated with broken symmetry states are of 
the order of e 2 /(e£) ~ 56^/B± [T]/e meV. The collec¬ 
tive modes [41] of valley coherent states are expected to 
be gapless, while those of valley polarized states are ex¬ 
pected to be gapped. 
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